Asymptotic Equipartition Property of Output when Rate is above Capacity
نویسندگان
چکیده
The output distribution, when rate is above capacity, is investigated. It is shown that there is an asymptotic equipartition property (AEP) of the typical output sequences, independently of the specific codebook used, as long as the codebook is typical according to the standard random codebook generation. This equipartition of the typical output sequences is caused by the mixup of input sequences when there are too many of them, namely, when the rate is above capacity. This discovery sheds some light on the optimal design of the compress-and-forward relay schemes.
منابع مشابه
Empirical distribution of good channel codes with non-vanishing error probability (extended version)
This paper studies several properties of channel codes that approach the fundamental limits of a given (discrete or Gaussian) memoryless channel with a non-vanishing probability of error. The output distribution induced by an ǫ-capacity-achieving code is shown to be close in a strong sense to the capacity achieving output distribution. Relying on the concentration of measure (isoperimetry) prop...
متن کاملLossy Asymptotic Equipartition property for Networked Data Structures
Abstract. This paper presents a rate-distortion theory for hierarchical networked data structures modelled as tree-indexed multitype process. To be specific, this paper gives a generalized Asymptotic Equipartition Property (AEP) for the Process. The general methodology of proof of the AEP are process level large deviation principles for suitably defined empirical measures for muiltitype Galton-...
متن کاملProperties of a Word-Valued Source with a Non-prefix-free Word Set
Recently, a word-valued source has been proposed as a new class of information source models. A word-valued source is regarded as a source with a probability distribution over a word set. Although a word-valued source is a nonstationary source in general, it has been proved that an entropy rate of the source exists and the Asymptotic Equipartition Property (AEP) holds when the word set of the s...
متن کاملGaussian feedback capacity
Abstracl-The capacity of time-varying additive Gaussian noise cbannels with feedback is characterized. Toward this end, an asymptotic equipartition theorem for nonstationary Gaussian processes is proved. Then, with the aid of certain matrix inequalities, it is proved that the feedback capacity C,, in bits per transmission and the nonfeedback capacity C satisfy C 5 CFB < 2C (a result obtained by...
متن کاملEngineering EE 194 – Network Information Theory Prof . Mai Vu Lecture 2 : Channel Capacity 1 Typicality and Joint Typicality
The Asymptotic Equipartition Property (AEP) in information theory is the analog of the Law of Large Numbers in probability theory. Assume that the binary random variable X has a probability mass function defined by p(1) = 2/3, and p(0) = 1/3, where X1,X2,...,Xn are i.i.d. random variables according to p(x), and we want to observe a realization of the sequenceX1,X2,...,Xn, where n −→ ∞. We will ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/0908.4445 شماره
صفحات -
تاریخ انتشار 2009